iPhone Video to Point Cloud with Visual SFM

hi everybody its Eugene this register and today I’d like to show you a little about how you can use your iPhone or the iPhone video to create a dense point cloud now one of the things you’re going to need patently is a video which I’ve done here of a tree trunk and so genuinely all I’m doing is trying to stay at about a constant distance around the tree trunk close enough to pick up some pretty good details and I also want to come back around to the other side and made to ensure that I have a little bit of overlap from the position where I first started so you’ll see that gradually as this comes to the end here and there we go okay so I’m going to be using visual sfm and one of the things that you need are likeness so you have to be able to extract individual portraits from the video now fortunately QuickTime Pro actually comes with the ability to export an persona sequence so you go I convey there’s a lot of other options but we’re going to choose image sequence and I’m likewise going to go to the options and you’ll be understood that I have a number of different idol options I want to stick with JPEG in frames per second you can choose 30 25 whatever but apparently the more devoting epitomes “youre using” or the highest the make proportion then you’re going to certainly certainly building and strengthening a whole lot of epitomes so we don’t want to be waiting here forever for this example we’re going to use five epitomes per second I’ve already done this so I is a well-known fact that that that’s a good number and certainly what you’re trying to do is balance between the number of images and processing duration and also the length between each epitomes if the enclose rate is too low and let’s say the camera was moving faster the distance or the idols might be too dissimilar that you might not get a lot of good aspect joins so the closer they are together surely the more feature accords you’ll do but you have to balance that likewise with the amount of go how much managing era you you’re willing to accept so I’m going to just say go ahead I’m in this folder announced tree and I’m just going to call this out tree underscore and it will automatically assign some counts on it save and starting to export that and I will bring up the when that’s done okay so let me exactly bring up the folder here and you can see here that it wrote see how many 134 different images so great now what we want to do is get back to visual sfm and there’s really four all measures necessary to visual sfm the first is really to load all the likeness so I’m just going to thump ctrl a and thump open and all the portraits get laden up now and in a second I should be able to see them all there they are okay so there’s all the hundred and thirty-four different portraits the second step is that I want to compute all the relationships or the features relationships between one photos to the other now because this is video and all the personas are sequential there’s specific features under sfm for pairwise parallelling calculate cycle equal so I want to do that and also what I would like to do is tell it how many photos in a row should it be looking for a join so you can choose as many as you like but patently as the numeral increases if you go ten makes forward the images might be dissimilar enough that you’ll have very few facet parallels so I’m going to stick with four for this particular quick project here and it’s going to stumble okay and it will now go ahead and start processing all that all the likeness for the feature pairing so I’m just going to punch interruption here and let it go it’s probably going to take a minute or two and and then I’ll switch it back on when it’s done okay so it actually didn’t take very long at all it looks a lot like it made about 26 seconds or so and so now I have all my aspects paired but what I would need to do is do like a kind of like a 3d renovation or a sparse reconstruction using all those feature match the points so all I need to do is just thumped that button right here and off it extends and you’ll see that it actually starts to construct matching all the features together and then putting the camera positions in there and gradually you’ll participate some of the camera positions coming through I’m going to let this do its thing as well and again probably exclusively take a couple of minutes and then what we’ll do the dense renovation from there okay so it took got a couple of minutes to finish but you can see that I’ve got are all the little bits of single epitomes that I have so you can see how I’ve the route that I’ve kind of discovered around the tree trunk and the overlap as well now on this particular tree trunk I can increase the size of these points if you want to know what I’m doing here I’m just hitting the see and mouse wheel for the portrait sizes or camera positions and all 10 ml moan in order to get the point sizes larger and smaller so this is great I’ve got the sparse point cloud done if that’s all you need then you know you can plainly export these points and do some things with it if not you want to move on the next step is to use the CMD SP mvs a little bit note about this if you want to change the settings all you have to do is hit the enroll and type in established and the settleds register comes up and so you can change some of the PPS CMBS locateds are here now I’m just going to stick with the default settings that I have and I’m going to hit OK now if for whatever reason you do to be amended and you run at this pitch you actually need to reload all the adjusts so just go to sfm more affairs reload all settings and formerly you do that you’ll have the latest changes saved and included in the CMBS processing so I’m just going to make CMBS go ahead it requests hey where do you want to save this substance I’m just going to call it tree video something like that knock save and it will start by undestroyed the images and it’s obviously going to take a little bit of era actually it may not take even that long but I’m just going to pause this for a little bit and then we’ll extend from there and we’re back it only took about 39 seconds to process all of that and if you want to get to the dense reconstruction and visual sfm time smacked the tab key and there you go you have your dense reconstruction now I can see that there’s some noise here that’s coming off of part of the trunk and this wasn’t here and I’m not exactly sure what this is but because I’m using video relatively low res and I’m moving there could be some blurring and some other difficulties because of the movement or some jerky movement things like that so but that’s easily cleaned up if you know if you’re using this for visualization certainly not a big deal something you can fix quite easily in mesh lab or whatever that might be now in the index that you precisely saved there is a mannequins register I can show you this here so I choice the reputation of tree videos so just go to this folder 0 0 and then under representations and you’ll see that there’s a appeal Wi-Fi file now and if you load this up into meshlab you’ll be able to visualize the level shadowed so that’s pretty much how you make love from start to finish not that bad not that difficult hope you enjoyed the video thanks

Related posts